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WE CLAIM: 

1 . An execution unit that maintains substantially peak data throughput 
in the unified execution of multiple media data sti^ams, the execution unit having 
a data path, comprising: 

a multi-precision arithmetic unityfcoupled to the data path, the multi- 
precision arithmetic unit capable of dynamicypartitioning based on the elemental 
width of data received from the data path* 

a switch coupled to the data path and programmable to manipulate 
data received from the data path, the switch providing data streams to the data 
path; and 

an extended mathematical element coupled to the data path and 
programmable to implement add^ional mathematical operations at substantially 
peak data throughput. 




2. The execution unit defin^ETin cl^im 1, wherein the multi-precision 
execution unit is configurable to divid# the dati into component symbols of various 
sizes, analyze the component symbols basedvj/pon instructions, and re-synthesize 
the component symbols for communication over the data path. 



20 3. The execution unit defined in claim 2, wherein the multi-precision 

execution unit iy operable to perform unique operations on each component 
symbol. 



4. / The execution unit defined in claim 2, wherein the mathematical 
25 element ii operable to perform finite group, finite field, finite ring and table look- 
up operations on the symbols. 

5. The execution unit defined in claim 1, wherein the arithmetic unit is 
programmable to perform Boolean, integer and floating point mathematical 

30 operations. 
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6. The execution unit defined in claim 5[, wherein the operations 
performed by the arithmetic unit are capable of bging performed at various levels 
of precision. 

7. The execution unit defined in c/aim 1, wherein the manipulation of 
data comprises copying, shifting and re-sizing data. 
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8. The execution unit defined An claim 1, further comprising control to 
maximize use of the execution unit by performing operations at peak data width of 
the data path. 



9. The execution unit defined in claim 2, wherein the size of 
component symbols match. 

15 10. An execution unit /having a data path, comprising: 

at least one register file coupled to the data path; 
a multi-precision arithmeticpum coupled to the data path, the multi- 
precision arithmetic unit capaole of dynamic' partitioning based on the elemental 
width of data received from/the data path; 
20 a switch coupled to the data path and programmable to manipulate 

data received from the dala path, the switch providing data streams to the data 
path; and 

an extended mathematical element coupled to the data path and 
programmable to implement additional mathematical operations at substantially 
25 peak data throughputs 
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11. An execution unit having a data path, comprising: 

a multi-precision arithmetic unit coupled to the data path, the multi- 
precision arithmetic unit capable of dynamic partitioning based on the elemental 
width of data received from the data path; 



- 47 - 



-48 

means coupled to the data path fck manipulating data received from 
the data path, the means for manipulating data jbzing programmable and providing 
a data signal to the data path; and 

an extended mathematical element coupled to the data path and 
programmable to implement additional mathematical operations at substantially 
peak data throughput. 



12. A general purpose programmable media processor having an 
instruction path and a data path to digitally process a plurality of media data 
10 streams, comprising: 

a high bandwidth external interface operable to receive a plurality of 
data of various sizes from an external source and communicate the received data 
over the data path at a rate that jnaintains substantially peak operation of the media 
processor; 

15 at least one register file configurable to receive and store data from 

the data path and to commurficate the ^forep data to the data path; and 

a multi-precision execi 
precision execution unit configurable to partition data received from the data path 
to account for the elemental symbolize of the plurality of media data streams, 
20 and programmable to operate on the data to generate a unified symbol output to 
the data path. 



25 



30 



13. The/media processor defined in claim 12, wherein the execution unit 
is dynamically configurable to partition data received from the data path. 

14. /The media processor defined in claim 12, further comprising: 
means for moving data between registers and memory by 

performing load and store operations, and for coordinating the sharing of data 
among a plurality of tasks by performing synchronization operations based upon 
instructions and data received by the execution unit; 
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means for securely controlling the sequence of execution by 
performing branch and gateway operations baspd upon instructions and data 
received by the execution unit; and 

a memory management unit, the memory management unit operable 
to retrieve data and instructions for timely £nd secure communication over the data 
path and instruction path. 
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15. The media processor defiAed in claim 14, further comprising: 
a combined instruction cftche and buffer, the combined instruction 

cache and buffer dynamically allocated between cache space and buffer space to 
ensure real-time execution of multiple media instruction streams; and 

a combined data cache and buffer, the combined data cache and 
buffer dynamically allocated betwden cache space and buffer space to ensure real- 
time response for multiple media/data streams. 

16. The media processor defined iAJlaM 15, wherein real-time 
execution is ensured by dynamically aUocating instruction buffer space to the 
smallest and most frequently/executed blocks of media instructions. 



20 17. The media processor defined in claim 15, wherein real-time 

response is ensured by dynamically allocating data buffer space to the smallest and 
most frequently accesses working sets of media data. 
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18. The meSdia processor defined in claim 12, wherein media data 
streams comprise Nyquist sampled inputs and outputs. 



19. The/media processor defined in claim 12, wherein media data 
streams originate/from standard computer memory and I/O interfaces. 



30 20. 'the media processor defined in claim 12, wherein the multi- 

precision execution unit is configurable to divide the data into component symbols 
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of various sizes, analyze the component symbfols based upon instructions, and re- 
synthesize the component symbols for communication over the data path. 

21. The media processor defined in claim 12, wherein the plurality of 
media data streams comprise presentation media information, transmission media 
information, and storage media information. 

22. The media processor defined in claim 21, wherein presentation 
media information comprises auaio, video, image, and graphical information 

23. The media processor defined in claim 21, wherein transmission 
media information comprises radio and netwprtfyiata transmissions;. 
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24. The media/processor defihcfcTTn daim 21, wherein storage media 
information comprises data encoded in moving and solid-state memory media. 



25. The media processor defined in claim 12, wherein the width of the 
data path is at leas/ 128 bits. 

20 26. The media processor defined in claim 12, wherein the multi- 

precision execution unit comprises a dynamically partitionable arithmetic unit, a 
register controllable cross-bar switch, and an extended mathematical element. 



25 



27. / The media processor defined in claim 24, wherein the register 
controUable cross-bar switch comprises a Benes network design. 
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>8. The media processor defined in claim 26, wherein the register 
controllable cross-bar switch is programmable and is operable to manipulate 
symbols. 
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29. The media processor defined in claim 22, wherein the extended 
mathematical element is operable to perform finite group, finite field, finite ring 
and table look-up operations on the symbols. 

30. The media proces$6r defined in claim 12, further comprising a set 
of predefined instructions accessible by a user. 

31. The media processor defjfoecyin claim 13, wherein the means for 
performing load, store,/4nd synchroitoiatirfSn operations and the means for 
performing branch anil gateway operations comprises a set of predefined 
instructions accessible by a user. 

32. /The media processor defined in claim 31, wherein the predefined 
instructiony are combinable to implement composite functions on the plurality of 
media dafta streams. 



%z A liigh bandwidth p rocessor i nterface fu r receivin g and transmittir 

a stream, comprising: 

a data path, the data path operable to transmit niedia information at 
sustained peak rates; 

a plurality of memory controlleps^fhe plurality of memory 
controllers coupled to the data path in series to communicate stored media 
information to and from the data^ith; and 

a plurality of oremory elements coupled to each of the plurality of 
memory controllers in parallel, the plurality of memory elements for storing and 
retrieving the medjafinformation. 




34/ The high bandwidth processor interface defined in claim 33, 
whereifi the data path comprises a plurality of data paths forming a high bandwidth 
! a - channel. ■ » 
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The high bandwidth processor interface defined in claim^J^ 
wherein the high bandwidth data channel is uni-dire£tional. 



6r TtK high bandwidth processor interface^ 



mable media processor coupled to the high 




in c l aim 33, farther 



comprising a general purpose 
andwidth <Jata-ehafinefto receive, process and transmit media information at 



istantially peak-rateST- 



The high bandwidth processor interface defined in claim 
10 wherein the peak rate of operation comprises at least one gigabyte of information 
per second from point to point. 




- — Th cHi i gh - band widtk- proccssor interface defined iinjkim 33, 
erein the plurality of memory controllers each comprise a paired link cU^posed 
between each memory controller, the paired links each for transmktiiig and 
receiving plural bits of data and having differential data inpijt8<and outputs and a 
differential clock signal. 



39. The high bandwidth processor interface defined in claim 38, 
20 wherein the paired link further comprises a digital skew calibrator to adjust the 
plural bits of data relative to tlje<aifferential clock signal to eliminate skew 
between the data. 



40. ^The high bandwidth processor interface defined in claim 38, 
25 whereijKffie paired link further comprises a phase locked loop to eliminate jitter in 
^ difforentia t- cloc l c Signal t ransmitted between paired links. 
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41. The highbandsadtlrpfocessor interface defined in claim 38, 

p l ural hits rnmprkp f4ght hitq nf f\rt*-^ 
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42: TBeTSghJnn dwidth proce ssoriiT 




wherein the 

impedances fui eauli paired-tinfc 



clairfi 3^, 

comprise termination resistors to form 



The high bandwidth processor interface defined in claint-3*f, 
wherein the high bandwidth data channel comprises plural parallel high bandwidth 
data channels. 
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44. A system for unified media pc6cessing comprising: 

a plurality of general purpose media processors, each media 
processor operable at sustained peak data yrates and having a dynamically 
partitioned execution unit and a high bandwidth interface, the high bandwidth 
interface coupled to external memory pd input/output elements to receive and ' 
transmit data to the media processor at substantially peak rates; 

a bi-directional communication fabric, the plurality of media 
processors coupled to the bi-directional communication fabric to transmit and 
receive at least one media stream comprising presentation, transmission, and 
storage media information. 



45. The system defined 
communication fabric comprises a 




44, wherein the bi-directional 
ptic network. 



46. The sys/em defined in claim 44, wherein the bi-directional 
communication fabruj comprises an heterogeneous network. 

47. The system defined in claim 44, wherein the bi-directional 
communication fabric comprises a coaxial cable network. 
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48. / The system defined in claim 44, wherein the bi-directional 
communication fabric comprises a wireless network. 
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49. The system defined in claim/44, wherein a subset of the plurality of 
media processors comprise network servei] 

50. The system defined in claim 44, wherein the plurality of media 
processors are programmable by downloading program information over the bi- 
directional communication fabric. 



10 



51. The system defined In claim 44, wherein the each of the plurality of 
media processors can access an idle execution unit of another media processor in a 
shared manner to efficiently process presentation, transmission and storage media 
information at substantially peoJc data rates. 



52. The system defined in claim 44, wherein each media processor 
further comprises dedicatecy memory and wheiein the each of the plurality of 
15 media processors can employ any unused pfpmon of the dedicated memory of 
another media processor In a shared mam^rjpefficiently store and retrieve 
presentation, transmission and storage xpfdi^ information at substantially peak data 
rates. 



20 53. A parallel multi-processor system that maintains substantially peak 

data throughput inythe unified execution of multiple media streams, the system 
having a data path, comprising: 

ay least one high bandwidth external interface, the at least one high 
bandwidth external interface coupled to the data path and operable to receive a 
25 plurality of data of various sizes from an external source and communicate the 
received data at a rate that maintains substantially peak operation of the parallel 
multi-processor system; 

a plurality of register files, each register file having at least one 
general purpose register coupled to the data path and operable to store a working 
30 set of njedia data; and 
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at least one multi-precision execution unit coupled to the data path, 
the at least one multi-precision execution unit /dynamically configurable to partition 
data within a working set of media data received from the data path to account for 
the elemental symbol size of the plurality of media streams, and programmable to 
operate in parallel on working sets of data/stored in the plurality of register files to 
generate a unified symbol output for eacly register file. 
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54. The parallel multi-processor system defined in claim 53, wherein 
the at least one execution unit alternates in a round robin manner to operate on 
data stored in the plurality of register files. 



55. The parallel multi-processor system defined in claim 53, further 
comprising an instruction pre-feton pipeline. 

15 56. The parallel mulii-processor/systeAi defined in claim 55, wherein 

the instruction pre-fetch pipeline comprises*4^tf^r-stiing pipeline. 
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57. The parallel multi-processor system defined in claim 55, wherein 
the instruction pre-fetch pipeline comprises a super-spring pipeline. 

58. The parallel multi-processor system defined in claim 53, further 
comprising a data pre-fietch pipeline. 
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59. The parallel multi-processor system defined in claim 58, wherein 
the data pre-fetch pipeline comprises a super-string pipeline. 



60. Tbjb parallel multi-processor system defined in claim 58, wherein 
the data pre-fetch pipeline comprises a super-spring pipeline. 



30 61. /The parallel multi-processor system defined in claim 53, further 

comprising a/requester, responder and transponder daemon. 
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62. A method for processing unified ^streams of media data, comprising 
the steps of: 

receiving a stream of unified n/edia data including presentation, 
transmission and storage information; 

dynamically partitioning theAinified stream of media data into 
component fields of at least one bit based/on the elemental symbol size of data 
received; and 

processing the unified styfeam of media data at substantially peak 

operation. 

63. The method defined ih claim 62, wherein the step of processing the 
unified stream of media data comprises the steps of: 

storing the stream of unified media data in a general register file; 

performing multi-precision arithmetic operations on the stored 
stream of unified media data based on progranimed instructions, the multi- 
precision arithmetic operation/ including JSooleap, integer and floating point 
mathematical operations; 

manipulathWthe comport fields of unified media data based on 
programmed instructions ipai implement copying, shifting and re-sizing operations; 
and 

performing multi-precision mathematical operations on the stored 
stream of unified media data based on programmed instructions, the mathematical 
operations including/finite group, finite field, finite ring and table look-up 
operations. 

64. The method defined in claim 63, further comprising the steps of: 
)re-fetching instructions and data to fill instruction and data 

pipelines; 

performing memory management operations to retrieve instructions 
and data fabm external memory; 
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storing instructions and data in instruction and data cache/buffers; 



and 




dynamically allocating bufferystorage in the instruction and data 
cache/buffers to ensure real-time execution 

65. The method defined in claim 63, further comprising the step of 
providing a set of instructions to process the stream of unified media data, the set 
of instructions including load, store, /synchronization, branch and gateway 
instructions. 

66. The method defined in claim 65, further comprising the step of 
programming a sequence of at /east one instruction from the set of instructions. 

67. A method for Achieving high bandwidth communications between a 
general purpose media processor and extemal^devices, comprising the steps of: 

providing a/high bandwiam interface disposed between the media 
processor and the external devices, theliigh bandwidth interface comprising at 
least one uni-directional channel pair having an input port and an output port; and 

transmitting and receiving a plurality of media data streams, 
comprising component fields of various sizes between the media processor and the 
external devices at £ rate that sustains substantially peak data throughput at the 
media processor. 



68. The method defined in claim 67, wherein the step of providing a 
25 high bandwidth interface further comprises providing a plurality of external 

devices, the /plurality of external devices coupled in series on the at least one uni- 
directional channel pair. 



60. The method defined in claim 67, wherein the step of providing a 
30 high baAdwidth interface further comprises providing a plurality of parallel uni- 
directional channel pairs. 
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70. A method for processing/streams of media data, comprising the 
steps of: / 

providing a bi-direcuonal communications fabric for transmitting 
and receiving at least one stream of unified media Jdata, the at least one stream of 
5 unified media data comprising presentationofraimnission and storage information; 

and / / / / 

providing/at least one prefgrammable media processor within the 
communications network, the at least one programmable media processor for 
receiving, processing and transmitting the at least one stream of unified media data 
10 over the bi-directional communications fabric. 
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